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This disclosure relates to a microscope system for 
viewing an area of a living body tissue that is rapidly 
moving, by maintaining the same area in the field-of- 
view and in focus. A focus sensing portion of the sys- 
tem includes two video cameras at which the viewed 
image is projected, one camera being slightly in front 
of the image plane and the other slightly behind it. A 
focus sensing circuit for each camera differentiates 
certain high frequency components of the video signal 
and then detects them and passes them through a 
low— pass filter, to provide DC focus signal whose 
magnitudes represent the degree of focus. An error 
signal equal to the difference between the focus sig- 
nals, drives a servo that moves the microscope objec- 
tive so that an in-focus view is delivered to an image 
viewing/recording camera. The lens system includes a 
moveable microscope objective which collimates rays 
from the object, and a transfer lens much larger than 
the objective lens for focusing the collimated rays 
onto the target plane of the viewing camera. 

7 Claims, 17 Drawing Figures 
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SERVO-CONTROLLED INTRAVITAL 
MICROSCOPE SYSTEM 

ORIGIN OF THE INVENTION 

The invention described herein was made in the per- 
formance of work under a NASA contract and is sub- 
ject to the provisions of Section 305 of the National 
Aeronautics and Space Acts of 1958, Public Law 
85-568 (72 Stat. 435; 42 USC 2457). 

BACKGROUND OE THE INVENTION 

This invention relates to a system for viewing a mov- 
ing object. 

The microscopic examination of unrestrained and 15 
normally functioning living tissue has not been possible 
in the case of ti.ssues of the heart, the lungs and other 
sides where the bodily region containing the tissue is 
moving. This is because the depth of field of a micro- 
scope is much smaller than the excursions of such tis- 
sue, so that in a stationary microscope the view would 
be in focus only a small proportion of the time. Also, 
the lateral excursions of the tissue are typically much 
greater than the field-of-view, so that the same ti.ssue 
area cannot be observed throughout its excursions, as 
in viewing a small region on a beating heart. The region 
of the body immediately around the ti.ssue under exam- 
ination can be restrained, but the greater the degree of 
restraint, The greater the interference with normal 
functioning of the organism. A microscopic viewing 
system which permitted viewing with a minimum, if 
any, restraining of the organism would be extremely 
useful in research and clinical examinations, especially 
in examining the microcirculation of certain moving 
organs, such as the heart and lungs. 

SUMMARY OF THE INVENTION 

In accordance with one embodiement of the present 
invention, a microscope viewing system is provided 
which can maintain an The enlarged view of a moving 
area of an object. Teh system includes a beamsplitter 
assembly behind the objective lens for directing light 
onto a viewing device and onto the targets of two video 
cameras, one target located slightly in front of the 
image plane and the other target located behind the 
image plane. A separate focus sensing circuit con- 
nected to each video camera includes a band pass filter 
for passing only the frequency components in an opti- 
mum high frequency band of the video signal, a differ- 
entiator, a detector, and a low-pass filter for generating 
a DC signal whose magnitude represents the degree of 
focus of the corresponding camera. The low-pass filters 
of the two circuits arc connected to a difference ampli- 
fier which generates a signal that drives a servo that 
moves the objective lens towards and away from the 
object. 

One microscope system moves the objective lens in 
two lateral directions as well as axially, so that the same 
area of the object can be held in the ficld-of-view in 
spite of large lateral excursions of the area. The optical 
.system for focusing the view onto the viewing device 
and video cameras includes a stationary transfer lens 
positioned behind the movable objective lens. The ob- 
jective lens is maintained by the .servo-.svslem at a dis- 
tance from the object equal to the local length of the 
objective lens, so that light rays from the objective lens 
are collimated (parallel to one another), fhe transfer 


2 

lens, which recives the collimated rays, is positioned in 
front of the image plane of the viewing device by a dis- 
tance equal to the focal length of the transfer lens. 
Thus, as the objective lens moves laterally, the colli- 
5 mated rays from it may emerge from different posi- 
tions, but these rays will always be precisely focused by 
the transfer lens onto the image plane of the viewing 
device. 

The novel features that are considered characteristic 
10 of the invention are set forth with particularity in the 
appended claims. The invention will best be under- 
stood from the following description when read in con- 
nection with the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

EIG. 1 is a block diagram view of a microscopic view- 
ing system constructed in accordance with the inven- 
tion; 

EIG. 2 is a block diagram of the focus circuits of EIG. 

20 1 ; 

FIGS. 3A-3E illustrate a simplified video pattern, 
and the type of signals generated by the focus circuits 
of FIG. 2 when the pattern is in focus; 

FIGS. 4A— 4E are similar to FIGS. 3A-3E, but for an 
25 out-of-focus condition; 

FIG. 5 illustrates the variation of the focus circuits 
outputs with distance of the video camera targets from 
the image plane; 

FIG. 6 illustrates the variation of the error signal de- 
2b livered to the servo, with deviation from an infocus 
condition; 

FIG. 7 is a block diagram representation of the servo 
of the system of FIG. I; 

FIG. 8 is a block diagram view of a microscope view- 
ing system constructed in accordance with another em- 
bodiment of the invention, for following an object area 
moving laterally as well as along the optical axis of the 
system; and 

FIG. 9 is a side elevation view of the lens system of 
FIG. 8. 

DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

FIG. I illustrates a microscopic viewing system 10 for 
viewing an area A of an object O, in which the area A 
may undergo large excursions along an axial direction 
indicated by arrows 12. The system includes an objec- 
tive lens 14 which can be moved along the axial direc- 
tion by a servo lens-moving mechanism 16. The mech- 
aism 16 maintains the lens 14 at a distance from the ob- 
ject area A equal to the focal length of the objective 
lens 14, so that collimated light rays emerge from the 
objective lens and reach a stationary transfer lens 18 
positioned behind the objective lens. A first beamsplit- 
ter 20, positioned behind the transfer lens, directs a 
fraction of the light onto the target 22 of a viewing de- 
vice 24 which may be a video camera foro recording 
the view on video tape, a film camera, or an optical di- 
rect viewing device. The other fraction of the light 
passes through the beamsplitter 20 onto a second 
beamsplitter 22. Some of the light is reflected by the 
second beamsplitter 22 onto the target 26 of a first 
video camera 28, while the rest of the light passes 
through the second beamsplitter and reaches the target 
30 of a second video camera 32. 

The targets 26, 30 of the two video cameras are posi- 
tioned close to the image planes 34, 36 where light 
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from the transfer lens 18 is focused, each of these 
image planes 34, 36 being spaced from the transfer lens 
18 by a distance (along the optical axis) equal to the 
focal length of the transfer lens 18. However, the target 
26 of one camera is positioned slightly behind the 5 
image plane 34, while the target 30 of the other camera 
is positioned slightly in front of the image plane at 36. 
Thus, the image viewed by the two cameras is slightly 
out of focus. The video signals to generated by the two 
cameras 28, 32 are delivered to a focus sensing system 10 
38 which processes the signals to generate a control sig- 
nal which indicates the amount and the direction in 
which the objective lens 14 must be moved in order to 
bring the image on the viewing device 24 clearly into 
focus. The focus circuit 38 is connected to the servo 15 
lens moving mechanism 16 to move the objective lens 
14 in a direction to return to an in-focus condition 
when the target area A moves out of focus. 

FIG. 2 illustrates the focus system 38 which com- 
pares the outputs of the two video signals to develop a 20 
control signal, for returning the sytem to an in-focus 
condition. The system includes two focus circuits 40, 

42 respectively connected to the cameras 28, 32, and 
difference amplifier 44 connected to the outputs of the 
two focus circuits. Each focus circuit, such as 40, is de- 25 
signed to genrate a DC signal whose amplitude depends 
upon the degree of focus (or out-of-focus) of the image 
on the corresponding video camera. This is accom- 
plished by utilizing the fact that video signals from an 
in-focus image contain the highest proportion of high 3® 
frequency components. When an image is in focus on 
a camera, its target “sees” sharp details, so that there 
are sharp slopes in the resulting video signal. When the 
image . becomes out of focus, the transitions in the 
image and hence the slopes in the video signal become 35 
less sharp. Accordingly, the differentiated video signals 
will provide smaller amplitudes in the case of an out of 
focus image. 

The focus circuit 40 includes a high-pass filter 46 
which passes only signals above certain frequency such 
as 100 KHz, these being the signals which change in the 
greatest proportion as the degree of focus changes. The 
output from the filter 46 passes through a low-pass fil- 
ter 48 with a cutoff frequency such as 300 KHz, which 
is utilized to reject primarily noise in this system. The 
output of the low-pass filter 48 passes through a differ- 
entiator 50 which is utilized to generate the focus indi- 
cating portion of the signal, namely the amplitude of 
the video slopes. The output of the differentiator is de- 
tected by a rectifier circuit 52, and then passed to a 
low-pass filter 54 with a cutoff frequency such as 50 
Hz. The low-pass filter 54 serves as an integrator to sum 
the rectified high frequency components so that a DC 
signal is developed which represents the magnitude of 
the slopes in the video signal. The output of the low- 
pass filter is delivered to the inverting input 56 of the 
differential amplifier 44. The other focus circuit 42 is 
similarly constructed, and it delivers its output to the 
non-inverting input of the differential amplifier 44. ^ 
Thus, the output line 58 of the inverting amplifier rep- 
resents the difference between the degree of focus of 
the two video cameras. This signal is delivered to the 
servo lens moving system 16 which moves the lens to- 
wards or away from the object so as to maintain the 
view in focus on the viewing device. 

An understanding of the focus system 38 can be ob- 
tained by considering the types of signals generated by 


the various circuits of the focus system for a given 
video pattern. FIG. 3A represents s a video Tma'ge 
which includes a series of vertical bars 60, which is 
presented only to illustrate the manner of operation of 
the invention. FIG. 3B illustrates the video signal gen- 
erated by a earner viewing the bar pattern, while FIG. 
3C illustrates the output of the differentiator through 
which the video signal is passed, which may be the dif- 
ferentiator 50 of FIG. 2. FIG. 3D illustrates the ouptut 
of the rectifier, such as 52, while FIG. 3E illustrates the 
output of the low-pass filter 54. 

FIG. 4A illustrates the bar pattern 60a when it is 
somewhat out-of-focus. When the bars are out-of- 
focus, their edges do not appear to undergo such a 
sharp transition from light to dark, and therefore the 
video signal 62a undergoes changes which are less 
sharp. The differentiated signal at 64a is therefore 
smaller, as is the rectified 66a. After the rectified signal 
has passed through a low-pass filter, the signal 68a is 
obtained which is of smaller value than the in-focus sig- 
nal 68. Thus, the DC signals 68 and 68a represent the 
degree of focus, and have valves determined by the de- 
gree of focus of the image on the video camera. 

FIG. 5 illustrates the manner of variation of the DC 
signal from each of the focus circuits, for various posi- 
tions of the camera targets with respect to the focus 
plane of the image. The graph 70 represents the magni- 
tude of the focus signal (such as signal 68), which is the 
output of the low-pass filter 54. When the focal plane 
of the image lies at the position P,, it lies directly on the 
target of the first video camera 28, so that camera No. 
1 is in focus and the DC focus signal is a maximum. 
With video camera No. 1 stationary, movement of the 
image plane in either direction away from the position 
P( results in a decrease in the DC signal 70. In a similar 
manner, the graph 72 represents the DC focus signal 
from the second camera 32. This focus signal 72 is 
greatest when the image plane lies at the positon Pa, 
and the signal decreases when the image plane away 
from this position. The system is designed to operate 
with the image plane at the position P3 wherein the two 
video camera are equally out of focus. At this position, 
P3, the two focus signals are equal, so that their differ- 
ence is zero. The dashed line 74 represents an imagi- 
nary focus signal which would be obtained from the 
viewing device 24. The viewing device is positioned so 
that its target lies at the position Pj, and therefore the 
image thereon is in focus when the difference between 
the focus signals 70, 72 from the two video cameras is 
equal. 

FIG. 6 illustrates the output of the difference ampli- 
fier 44, which represents the difference between the 
two focus signals 70, 72. This difference or control sig- 
nal 76 not only passes through zero when the viewing 
device is in focus, but has a polarity which indicates the 
direction in which the objective lens 14 of the system 
must be moved to return the sytem to an in-focus con- 
dition. The error signal 76 varies almost linearly with 
position about the in-focus position P3, and it increases 
with deviations from the in-focus position between the 
positions P, and Pj at which the image planes passes the 
targets of the video cameras. 

FIG. 7 illustrates the servo lens moving system 16 
which utilizes the error signal 76 generated by the dif- 
ference amplifier 44 to move the objective lens 14. The 
servo system includes a hydraulic actuator 80 with a 
piston that can he moved in two directions by admitting 
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pressurized fluid on either side of it, and a valve 82 
which controls the flow of the hydraulic fluid. The 
valve is controlled by a signal from an amplifier 90 
whose input is connected to an adder 86 which also re- 
ceives the output of a feedback element 88, the signal 
on a line 84, and a velocity feedback signal from ele- 
ment 103. It would be possible to connect the differen- 
tial amplifier 44 directly to the line 84 that controls the 
valve, so that the movement of the objective lens 14 
was at a rate proportional to the deviation of the image 
plane from an in-focus position. However, better con- 
trol is obtained by utilizing a differentiator 92 which 
generates the differential of the error signal from the 
•differential amplifier 44. While the output of the differ- 
ential amplifier 44 represents the position error of the 
objective lens, the output of differentiator 92 repre- 
sents the time rate of change of the error (error veloc- 
ity). By adding the position error on line 58 to the error 
velocity generated by differentiator 92 in a summing 
circuit 94, a control signal is obtained which permits 
the objective lens to be held closer to the in-focus posi- 
tion. 

The focus system is typically set up to maintain the 
greatest degree of focus at the viewing device 24, that 
is, to maintain the greatest sharpness of detail. How- 
ever, the tissue being studied may have considerable 
variations in height in the area being viewed, as com- 
pared to the depth of field of the system. It is often de- 
sirable to permit the physician or other operator to 
make slight adjustments in the distance between the 
objective lens and a given point of the viewed area, so 
that, for example, the details at the peaks of the ‘ter- 
rain’ can be brought into sharpest focus. The servo 16 
shown in FIG. 7 includes a DC bias control 100 con- 
nected to an adder 101, which permits the addition of 
a small DC signal to the error signal entering the sum- 
ming circuit 94. This results in effectively shifting the 
error signal 76 shown in FIG. 6 upward or downward 
by a slight amount, so that instead of the servo system 
seeking the position P3, it seeks another point spaced 
a small distance therefrom. By turning a knob 102 or 
other manual control on the DC bias control 100, the 
physician can easily shift the focus point to bring the 
device into focus on any location within the viewed 
area. 

Another method for making slight adjustments in the 
distance from the objective lens 14 to the point on the 
viewed area A is to shift the position of one of the video 
cameras 28 or 32 along the optical axis. However, such 
shifting also alters the range and sensitivity of the servo 
system, and the smooth mechanical movement of a del- 
icate camera without introducing vibrations or other 
disturbances is generally more difficult than the move- 
ment of a rheostat wiper or the like. Movement of the 
video cameras is provided by a manual control 103 
(FIG. 1 ), but this is usually done in setting up the sys- 
tem for a given application. 

The micro.scope viewing .system 10 is useful in situa- 
tions where the area A to be viewed does not undergo 
large lateral excursions in addition to the axial excur- 
sions. Where large lateral excursions also occur, the 
system 200 illustrated in FIG. 8 can be utilized to keep 
the object area A constantly in the field of view as well 
as in focus. The system 200 is similar to the axial- 
moving system 10 of FIG. 1, except that a lateral video 
processor 202 is utilized to generate error signals indi- 
cating lateral shifting of the image. Also, an additional 
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lateral servo and lens moving mechanism 204 is pro- 
vided to move the objective lens laterally, and a larger 
transfer lens 206 is utilized. The lateral video processor 
is an off-the-shelf device manufactured by the DBA 
5 Company of Melbourne, Fla., which can be connected 
to the output of a video camera, and which generates 
signals indicating the direction of shifting of an image 
on the video target along two axes (the X and Y axes, 
which are perpendicular to the optical axis of the ob- 
10 jective lens). Signals from the processor 202 are deliv- 
ered to the servo mechanism 204 which includes hy- 
draulic actuators that move the objective lens assembly 
in two lateral directions to correct for lateral shifting. 
In may be noted that the processor 202 can be con- 
15 nected to either of the video cameras 28, 32 that are 
normally slightly out of focus, although connection to 
the in-focus viewing device 24 is generally preferred. 
Both the processor 202 and lateral servo mechanism 
204 are mechanisms well known in the art. However, 
20 a novel lens assembly is provided which includes the 
objective lens 14 and transfer lens 206, to permit exten- 
sive lateral excursions of the objective lens while main- 
taining the image unchanged on the viewing device 24. 

FIG. 14 illustrates the optical system, which includes 
25 the objective lens 9 and large transfer lens 206, for 
maintaining an image of the object area A on the target 
22 of the viewing device 24, The objective lens 14 is 
maintained at a distance f, from the object area A, so 
that light rays from the object area are collimated (par- 
30 ailel to one another) behind the objective lens. These 
collimated rays pass through the transfer lens 206, 
which focuses them on the viewing device 24 because 
the target 22 of the viewing device is spaced from the 
transfer lens 206 by a distance /j equal to the focal 
33 length of the transfer lens. When the objective lens 14 
moves laterally as to the position 14o, the light rays 
leaving the objective lens are still collimated and they 
will still be imaged at the same location on the viewing 
device target 22. Also, the magnification of the image 
does not change as the objective lens 14 moves axially 
or laterally without rotation. Thus, it is only necessary 
to move a relatively light weight objective lens in order 
to maintain a stable and in-focus image on the viewing 
device inspite of large axial and lateral excursions of 
the object area A. The transfer lens 206 must have a di- 
ameter considerably larger, i.e., at least twice as large, 
as the diameter of the object lens 14 in order to accom- 
modate large lateral excursions of the objective lens, 
and the transfer lens 206 preferably has a diameter at 
^ least five times as large as that of the objective lens. 

Thus, the invention provides a microscopic viewing 
system which maintains an in-focus magnified view of 
a moving object area. Axial excursions of the object 
area are compensated by a focusing system which in- 
cludes a pair of video cameras, the target of one cam- 
era being located in front of the image plane and the 
target of the other camera located behind the image 
plane. The video signals from the two focusing cameras 
are processed by focusing circuits to develop an error 
signal that indicates the direction of deviation from an 
in-focus condition, so that the objective lens of the sys- 
tem can be moved accordingly. A viewing system is 
also provided which can move the objective lens later- 
ally to track the object area in large lateral excursions. 
This system employs a transfer lens much larger than 
the objective lens, to focus collimated rays from a vari- 
ety of lateral positions of the objective lens. Of course. 
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concave mirrors can be utilized as the lenses, to pro- 
vide lens means, or optic means, for directing light, and 
prisms can be utilized as well as partially transmitting 
mirrors as the beamsplitter means. 

Although particular embodiments of the invention 5 
have been described and illustrated herein, it is recog- 
nized that modifications and variations may readily 
occur to those skilled in the art and consequently it is 
intended that the claims be interpreted to cover such 
modifications and equivalents. 10 

What is claimed is; 

1. Microscope apparatus for viewing a moving area 
of an object comprising: 

lens means positioned behind the object; 
lens moving means for moving the lens means; 15 

viewing means positioned behind the lens means; 
first and second video camera means positioned be- 
hind the lens means for generating video signals, 
the first camera means positioned slightly behind 
the image plane of the lens means and the second 20 
camera means positioned slightly in front of the 
image plane of the lens means; 
beamsplitter means positioned behind the lens means 
and in front of the viewing means and the video 
camera means, to pass light to the viewing means 25 
and each camera means; 

first and second focus sensor circuits respectively 
connected to the outputs of the video camera 
means, each focus circuit including a first electrical . 
filter for passing only predetermined high fre- 30 
quency components of the video signal, low pass 
filter means for integrating signals representing the 
high frequency components, and means for cou- 
pling the first filter to the low pass filter means; 
difference circuit means coupled to the outputs of 35 
the first and second focus means for generating a 
signal value representing the difference between 
the outputs of the low pass filter means of the two 
focus circuits; and 

servo means coupled to said difference means for en- 40 
ergizing the lens moving means to move the lens 
means with a directional component toward and 
away from the object. 

2. The apparatus described in claim 1 including: 
rhanually adjustable bias means for generating a vari- 45 

able bias signal; and 

means for coupling the bias means to the servo 
means, to add the bias signal to the difference be- 
tween the outputs of the low pass filter means of 
the first and second focus circuits, whereby to en- 50 
able slight change of the distance between the ob- 
jective lens and object even as the object moves. 

3. The apparatus described in claim 1 including; 
manually operable means coupled to one of said 

video cameras for varying its distance from the lens 55 
means. 

4. The apparatus described, in claim 1 wherein: 
said means, in each focus circuit, for coupling the 

first filter to the low pass filter means, includes a 
differentiating circuit and a detector. 60 

5. The apparatus described in claim I wherein: 
said lens means includes a microscope objective lens 

positioned behind the object at a distance equal to 
the focal length of the objective lens, and a transfer 
lens positioned in front of the viewing means by a 65 
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distance equal to the focal length of the transfer 
lens; 

said transfer lens is held stationary; and 
said lens moving means is coupled to the objective 
lens to move it while the transfer lens remains sta- 
tionary. 

6 , Microscope apparatus for viewing a moving area 
of an object comprising: 

a microscope objective lens mounted for movement 
at least axially toward and away from the object; 
a transfer lens mounted behind the objective lens; 
beamsplitter means mounted behind the transfer 
lens; 

first and second video cameras mounted behind the 
beamsplitter means, at distances from the transfer 
lens respectively slightly greater and slightly less 
than the focal length of the transfer lens; 
first and second focus circuits respectively connected 
to the first and second cameras, each circuit in- 
cluding a bandpass filter for passing only predeter- 
mined frequency components of the video signal 
from its corresponding camera, a differentiator for 
generating the time derivative of the high fre- 
quency components, and a detector and low fre- 
quency filter circuit for integrating the derivative 
signal; 

a difference circuit connected to the two focus sens- 
ing circuits; 

a servo circuit for generating a drive signal depen- 
dent upon the output of the difference circuit; and 
a transducer connected to the servo circuit and me- 
chanically coupled to the microscope objective 
lens, for moving the objective lens toward and 
away from the object. 

7. Microscope apparatus for viewing a moving area 
of an object comprising: 

an objective lens behind the object and mounted to 
move axially toward and away from the object as 
well as laterally; 

a transfer lens of larger diameter than the objective 
lens and mounted behind the objective lens; 
viewing means mounted behind the transfer lens at a 
distance therefrom approximately equal to the 
focal length of the transfer lens, for detecting an 
image substantially focused at the viewing means; 
and 

lens moving means responsive to changes in the focus 
and position of the image at the viewing means for 
moving the objective lens, with respect to the trans- 
fer lens, laterally as well as axially towards and 
away from the object, to compensate for lateral 
and axial movements of the object area; 
said viewing means including a video camera for gen- 
erating a video electrical signal, an electrical filter 
for passing only predetermined frequency compo- 
nents of the video signal, a differentiating circuit 
coupled to the filter, a detection means, a low pass 
filter for integrating the output of the detecting 
means, and means for generating a control signal of 
a magnitude dependent upon the output of the low 
pa.ss filter means; and 

.said lens moving means being constructed to move 
the lens axially in response to the control signal. 
***** 



